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Abstract 

For discrete time nonlinear systems satisfying an exponential or finite time controllability 
assumption, we present an analytical formula for a suboptimality estimate for model predictive 
control schemes without stabilizing terminal constraints. Based on our formula, we perform a 
detailed analysis of the impact of the optimization horizon and the possibly time varying control 
horizon on stability and performance of the closed loop. 
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1 Introduction 

The stability and performance analysis of model predictive control (MPC) schemes has attracted con- 
siderable attention during the last years. MPC relies on an iterative online solution of finite horizon 
optimal control problems in order to deal with an optimal control problem on an infinite horizon. 
To this end, a performance criterion — often the distance to some desired reference — is optimized 
over the predicted trajectories of the system. This method is particularly attractive due to its ability 
to explicitly incorporate constraints in the controller design. Due to the rapid development of effi- 
cient optimization algorithms MPC becomes increasingly applicable also to nonlinear and large scale 
systems. 

Two central questions in the analysis of MPC schemes are asymptotic stability, i.e., whether the 
closed loop system trajectories converge to the reference and stay close to it, and closed loop perfor- 
mance of the MPC controlled system. In particular - since desired performance specifications (like, 
e.g., minimizing energy or maximizing the output in a chemical process) can be explicitly included in 
the optimization objective - the latter provides information on how good this objective is eventually 
satisfied by the resulting closed loop system. For MPC schemes with stabilizing terminal constraints 



the available analysis methods have reached a certain degree of maturity, see, e.g., the survey |15| 
and the references therin. Despite their widespread use in applications, cf. [|T7|, for schemes without 
stabilizing terminal constraints — considered in this paper — corresponding results are more recent 
and less elaborated. Concerning stability, the papers [[T}|5|[TT| show (under different types of control- 
lability or detectability conditions) that stability can be expected if the optimization horizon is chosen 
sufficiently large, without, however, aiming at giving precise estimates for these horizons. 
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Closed loop performance of MPC controlled systems is measured by evaluating an infinite horizon 
functional along the closed loop trajectory. Suboptimality estimates, which typically allow to con- 
clude stability of the closed loop, are then obtained by comparing this value with the optimal value 
of the infinite horizon problem. In [I9j an estimation method of this type for discrete time linear sys- 
tems is presented which relies on a numerical approximation of the finite time optimal value function. 
Since for nonlinear or large scale systems this function is usually not computable, in |jTO| a method 
for finite or infinite dimensional discrete time nonlinear systems using ideas from relaxed dynamic 
programming has been presented. This approach allows for performance estimates based on con- 
trollability properties. Motivated by these results, in f6l a linear program has been developed whose 
solution precisely estimates the degree of suboptimality from exponential or finite time controllability. 

The present paper builds upon [6| extending the analysis from this reference to MPC schemes with 
time varying control horizon, i.e., the interval between two consecutive optimizations or, equivalently, 
the interval on which each resulting open loop optimal control is applied. This setting is motivated 
by networked control systems in which the network performance determines the control horizon, 
see IjSj^l and the discussion after Remark 2.4 below. In particular, we thoroughly investigate the 
impact of different — possibly time varying — control horizons on the closed loop behavior 

Moreover, we give an analytic solution to the linear program from [6 ] and - as a consequence - an 
explicit formula for the suboptimality estimate based on the ^^o-function characterizing our con- 
trollability assumption. This allows for a much more detailed analysis which is the main contribution 
of this paper. We investigate - among others - the impact of the optimization horizon, i.e., the inter- 
val on which the predicted trajectory is optimized (and which we choose identical to the prediction 
horizon), on the suboptimality and stability of the MPC closed loop. Especially, we prove conjectures 
from Q with respect to minimal stabilizing horizons which were based on numerical observations. 
Furthermore, we analyze the influence of adding a final weight in the finite horizon cost functional. 

The paper is organized as follows. In Section[2]we describe the setup and problem formulation. In 
Section [3] we introduce our controllability assumption and briefly summarize the needed results from 
[|6|. In Section]?] we show that our suboptimality result can be used to conclude stability, extending 
[]6| Section 5] to time varying control horizons. In Section ]5] we present the explicit formula for 
our suboptimality index a in Theorem |5.4[ In the ensuing sections we examine effects of different 
parameters on a. In particular, in Section ]6] we investigate the impact of the optimization horizon 
and in Sections ]7] and [8] we scrutinize qualitative and quantitative effects, respectively, of different 
control horizons. Finally, in Section ]9] we illustrate our results with numerical examples. A number 



of technical lemmata and their proofs can be found in the appendix in Section 10 



2 Setup and Preliminaries 

We consider a nonlinear discrete time control system given by 

x{n^l)= f{x{n),u{n)), x{Q) = xq (1) 

with x{n) E X and u{n) E U for n E Nq. Here the state space X and the control value space U are 
arbitrary metric spaces. We denote the space of control sequences u : Nq U hy ^ and the solution 
trajectory for given u E ^ by jCj,(-). Note that constraints can be incorporated by replacing X and U 
by appropriate subsets of the respective spaces. For simplicity of exposition, however, we will not 
address feasibility issues in this paper. 

A typical class of such discrete time systems are sampled-data systems induced by a controlled 
— finite or infinite dimensional — differential equation with sampling period T > 0. In this situation, 
the discrete time n corresponds to the continuous time t = nT . 

Our goal is to minimize the infinite horizon cost J^{xq, u) = L^=o ^(•^"(") with running cost 



I : X X U Mq by a multistep state feedback control (rigorously defined below in Definition 2.2). 
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We denote the optimal value function for this problem by Voo(xo) := infi<£'^yoo(xo,M). Since infinite 
horizon optimal control problems are in general computationally infeasible, we use a receding horizon 
approach in order to compute an approximately optimal controller. To this end, we consider the finite 
horizon functional 

Jn{xo,u) = l{xu{n),u{n)) (2) 

with optimization horizon N inducing the optimal value function 

Vn{xo) = inf Jj^{xo,u). (3) 

By solving this finite horizon optimal control problem we obtain N control values /i(jco,0),/i(;co5 1)? 
...,ll{xo,N—l) depending on the state xq. Implementing the first mo G { 1 , . . . , A^^ — 1 } elements of this 
sequence yields a new state x{mo). Iterative application of this construction then provides a control 
sequence on the infinite time interval, whose properties we intend to investigate in this paper. To this 
end, we introduce a more formal description of this construction. 

Definition 2.1. Given a set M C {1, . . . ,m*}, m* G N, we call a control horizon sequence {mi)i^f^Q 
admissible ifnii G M holds for all i G Nq. Furthermore, for A:, n G No we define 

k-l 

^i^) •= (using the convention Y,j1q = 0) 

(p{n) := max{o{k)\k eNo.oik) < n}. 
Using this notation, the applied control sequence can be expressed as 

...,^{x{a{k)),0),...,[i{x{o{k)),mk-l),ii{x{o{k+l)),0),... 
A closed loop interpretation of this construction can be obtained via multistep feedback laws. 

Definition 2.2. For m* > 1 and MC{l,...,m*}a multistep feedback law is a map /i : X x {0, . . . , 

m* — 1} U which for an admissible control horizon sequence {mi)i(^^^^ is applied according to the 
rule Xn (0) = Xq, 

x^{n+l) = f{x^{n),^{x^{(p{n)),n~(p{n))). (4) 

Using this definition, the above construction is equivalent to the following definition. 

Definition 2.3. Form* > 1 andN > m*+ 1 we define the multistep MPC feedback law iiN^m*{xo,n) : = 
u*{n), where u* is a minimizing control for ([3]) with initial value xq. 

Remark 2.4. For simplicity of exposition here we assume that the infimum in ([3]) is a minimum, i.e., 
that a minimizing control sequence u* exists. 

Note that in "classical" MPC only the first element of the obtained finite horizon optimal sequence 
of control values is used. Our main motivation for considering this generalized feedback concept with 
varying control horizons m, are networked control systems (NCS) in which the transmission channel 
from the controller to the plant is subject to packet dropouts. In order to compensate these dropouts, 
at each successful transmission time o{k) a whole sequence of control values is transmitted to the 
plant. This sequence is then used until the next successful transmission at time o{k+ 1) = o{k) +mk, 
for details see [8|. Note that in this application the control horizon m^ is not known at time o{k). 

In this paper we consider the conceptually simplest MPC approach imposing neither terminal 
costs nor terminal constraints. In order to measure the suboptimality degree of the multistep feedback 
for the infinite horizon problem we define 

oo 

V^'^'^^Hxo) ■.= l^l{x,{n),^{x,i(p{n)),n-(p{n))). 

n=0 
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Our approach relies on the following result from relaxed dynamic programming [T3| 18 1, which is a 
straightforward generalization of proposition |6i Proposition 2.4], cf. [8] for a proof. 

Proposition 2.5. Consider a multistep feedback law /i : X x {0, . . . ,m* — 1} — )■ i7, a 5ef M C {1, 

. . . ,m*} and a function V : X — )■ and assume that for each admissible control horizon sequence 
(w^OiGNo <^^d each xq&X the corresponding solution Xfxin) with jc^(O) = xq satisfies 

V{xQ)>V{x-^{mQ)) + a £ l{xfi{k),il{xo,k)) (5) 

k=0 

for some a G (0, 1]. Then for all xq E X and all admissible (m/)j£Ny the estimate aVoo{xo) < a 
vt^""\xo) <V{xo) holds. 



3 Controllability and performance bounds 

In this section we introduce an asymptotic controllability assumption and deduce several conse- 
quences for our optimal control problem. In order to facilitate this relation we will formulate our 
basic controllability assumption, below, not in terms of the trajectory but in terms of the running cost 
/ along a trajectory. 

To this end, we say that a continuous function p : ]R>o — )■ M>o is of class if it satisfies p(0) = 0, is 
strictly increasing and unbounded. Furthermore, we say that a continuous function /3 : ]R>o x ]R>o — )■ 
]R>0 is of class J^=Sf o if for each r > we have lim/^oo /3 (r, t) =0 and for each ? > we either have 
j8 (■, ?) G or /3 (■, =0. Note that in order to allow for tighter bounds for the actual controllability 
behavior of the system we use a larger class than the usual class ^ . It is, however, easy to see that 
each /3 G can be overbounded by a j8 G J^=Sf, e.g., by setting j8(r,r) = sup^>^ /3 (r, t) 

Moreover, we define := min„£(/ /(jc, u). 

Assumption 3.1. Given a function /3 G J^=Sf o, for each G X there exists a control function u^q G ^ 
satisfying I {xu^^^ {n),Uxf,{n)) < j5{l*{xo),n) for all n eNq. 

Special cases for /3 G ^=Sf o are 

l5{r,n)=Co"r (6) 
for real constants C > 1 and a G (0, 1), i.e., exponential controllability, and 

I5{r,n) = cnr (7) 

for some real sequence {c„)n^fq^ with c„ > and c„ = for all n > no, i.e., finite time controllability 
(with linear overshoot). 

For certain results it will be useful to have the property 

15 {r, n + m) < 15(15 {r,n),m) for all r > 0,n,m G Nq. (8) 

Property ([8]) ensures that any sequence of the form X„ = I5{r,n), r > 0, also fulfills Xn+m < /3(A„,m). 
It is, for instance, always satisfied in case ([6]) and satisfied in case (|7]) if and only if Cn+m ^ CnCm- 

If 

needed, this property can be assumed without loss of generality, cf. [|6| Section 3]. 
In order to ease notation, we define the value 

5ivW:= £'/3(r,n). (9) 



for any r > and any G N>i . An immediate consequence of Assumption 3.1 and Bellman's 
optimality principle Vf^i{x) = min„£(y{/(x,M) + V/v_i(/(x,m))} are the following lemmata from [|6l. 
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Lemma 3.2. For each N > I the inequality 

Vn{xo) < 5w(r(xo)) 

holds. 



(10) 



Lemma 3.3. Suppose Assumption \3.1\ holds and consider xq & X and an optimal control u* for 
the finite horizon optimal control problem Q with optimization horizon N > I. Then for each 
j = 0, . . . ,N — 2 the inequality 



JN-jiXu*U)yU+-)) < Bm-j{1\Xu-U)) 

and for each m= \,. . . ,N — \ and each j = 0,. . . ,N — m— 1 the inequality 

Vn {xu* (m) ) < Jj {xu* {m),u*{m + -))+BN-j{l* {xu* (m + j) ) ) 
holds for B^-j from (|9]). 



(11) 



(12) 



Now we provide a constructive approach in order to compute a in (|5]) for systems satisfying 
Assumption 3.1 Note that ([5]) only depends on mo and not on the remainder of the control horizon 
sequence. Hence, we can perform the computation separately for each control horizon m and obtain 
the desired a for variable m by minimizing over the oc-values for all admissible m. 

For our computational approach we consider arbitrary values Aq, . . . ,^n-i > and v > and 
start by deriving necessary conditions under which these values coincide with an optimal sequence 
l{xu*{n),u*{n)) and an optimal value Vpj{xu*{m)), respectively. 



Proposition 3.4. Suppose Assumption \3.1\ holds and consider N > 1, mG {I, ... ,N — I}, a sequence 
A,n>0, n = 0,...,N—\, and a value v > 0. Consider xqEX and assume that there exists a minimizing 
control u* E'^ for ^ such that A„ equals l{xu*{n),u*{n)) for all n E {0, . . . ,N — \}. Then 



N-l 



Y.K<BN-k{h), k = 0,...,N-2 

n=k 



(13) 



holds true and if furthermore v = V^{xu*{m)) we have 



V < ^ Xn+,n + B]\l-j{Xj- 
n=0 



j = 0,...,N-m-l. 



(14) 



Proof. If the stated conditions hold, then A„ and v meet the inequalities given in Lemma 3.3 which 
is exactly ([13]) and ([U]). □ 
Using this proposition a sufficient condition for suboptimality of the MPC feedback law /iA^.m is 
given in Theorem 3.5 which is proved in [6|. 

Theorem 3.5. Consider /3 G .J^ ^q, N> l,mG{l,...,A'^— 1}, and assume that all sequences A„ > 0, 
n = 0, . . . , — 1 and values v > fulfilling ([T3]), ([14]) satisfy the inequality 



N-l 

E 

n=0 



m—i 

A„ - V > a A„ 

n=0 



(15) 



for some cc G (0, 1]. Then for each optimal control problem ([T]), ([3]) satisfying Assumption 3.1 the as- 
sumptions of Proposition 2.5 are satisfied for the multistep MPC feedback law llN,m <^nd in particular 
the inequality CtKo(jc) < (XVoo^'"\x) < V^{x) holds for all x EX. 
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In view of Theorem |33 the value a can be interpreted as a performance bound which indicates 
how good the receding horizon MPC strategy approximates the infinite horizon problem. In the 
remainder of this section we present an optimization based approach for computing a. To this end, 
consider the following optimization problem. 

Problem 3.6. Given /3 G ,J^^q, N >1 and mG{l,...,A^— 1}, compute 



a. 



'N.m 



inf 

Ao,...,Aaj_i,V 



subject to the constraints ([13]), ([14]), and Aq, 



Era— 1 T 

A^_i,v >0. 



The following is a straightforward corollary from Theorem 3.5 

Corollary 3.7. Consider /3 G J^^q, N > 1, mG {1, . . . ,N — 1}, and assume that the optimization 
problem 3.6 has an optimal value cc G (0, 1]. Then for each optimal control problem ([!]), ([3]) satisfying 



Assumption \3.1\ the assumptions of Theorem \3.5\ are satisfied and the assertions from Theorem \375 
hold. 

As already mentioned in [[6] Remark 4.3], our setting can be easily extended to the setting includ- 
ing an additional weight (O > 1 on the final term, i.e., altering our finite time cost functional by adding 
{co — l)l{xu{N — I) , u{N — I)) . Note that the original form of the functional is obtained by setting 
(0 = 1. All results in this section remain valid if the statements are suitably adapted. In particular, (|2]) 
and ([9]) become 

N-2 

Jn{xo,u) := /(jc„(n),M(n)) + ft)/(jCj,(A^-l),a(A^-l)) 

n=0 
N-2 

BNir) := j;j8(r,n) + (Oj8(r,A^-l). 

n=0 



(16) 



and the formula in Problem [33] alters to 



a 



'N.m 



inf 



Lm—l 1 
n=0 ^« 



(17) 



4 Asymptotic stability 

In this section, which extends (6} Section 5] to varying control horizons, we show how the perfor- 
mance bound a = wsqA in order to conclude asymptotic stability of the MPC closed loop. 
More precisely, we investigate the asymptotic stability of the zero set of /*. To this end, we make the 
following assumption. 

Assumption 4.1. There exists a closed set A cX satisfying: 

(i) For each x eA there exists u eU with f{x,u) G A and l{x,u) = 0, i.e., we can stay inside A 
forever at zero cost. 

(ii) There exist J^aa-functions CCi, CC2 such that the inequality 

ai(||^IU)</*W<a2(|WU) (18) 
holds for each x EX where \\x\\a '■= min,,£^ ||.jc — 
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This assumption assures global asymptotic stability of A under the optimal feedback for the in- 
finite horizon problem, provided /3 (r, n) is summable. We remark that condition (ii) can be relaxed 
in various ways, e.g., it could be replaced by a detectability condition similar to the one used in [j5|. 
However, in order to keep the presentation in this paper technically simple we will work with As- 



sumption 4.1 li) here. Our first stability result is formulated in the following theorem. Here we say 
that a multistep feedback law ji asymptotically stabilizes a set A if there exists j8 G J^=Sf o such that 
for all admissible control horizon sequences the closed loop system satisfies < /3(||xo||a7")- 



m*}. Assume that 
Then 



3.6 



Theorem 4.2. Consider j5 G Jff^o, m* > 1 and N >m* +1 and asetMC{l, 
a* := min,neM{oc^ m} > ^ where OC^ denotes the optimal value of optimization Problem 
for each optimal control problem ([T]), ([3]) satisfying the Assumptions 3. 1 and 4. 1 the multistep MPC 
feedback law jlN.m* asymptotically stabilizes the set A for all admissible control horizon sequences 
{f^dieNo- Furthermore, the function V/v <^ Lyapunov function at the transmission times o{k) in the 
sense that 



(19) 



-aX,(^M„,„.(cT(fc))) 



holds for all ^ G No and xq G X. 



Proof. From ( [18] ) and Lemma 3.2 we immediately obtain the inequality 

a\{\\x\\A) <Vn{x) <BN{a2{\\x\\A)). 



(20) 



Note that o a2 is again a J^-function. The stated Lyapunov inequality ( [T9| ) follows immediately 
from the definition of a* and ([5]) which holds according to Corollary 3.7 for all m G M. Again, using 



( [18] ) we obtain Vm{x) > a\{\\x\\A) and thus a standard construction (see, e.g., [16|) yields a 
function p for which the inequahty Vf4{x^^ ^^{o{k))) < p{Vi^{x),k) < p(V/v(jc), [o{k)/m*\) holds. In 
addition, using the definition of ll/^,m* , for p = 1 , . . . , myt — 1 , G No, and abbreviating x{n) = (n) 
we obtain 

VN{x{o{k)+p)) 

< £ Z(x(n),Aiiv,m*(^(<P(«)),«-<P(«))) 

n=a{k)+p 

+ VN-mk+p{x{(y{k+l))) 
CT(fc+l)-l 

< l{x{n),^N,m*{^{^{n)),n~(p{n))) 

n=a{k) 

+ VM-m,+p{x{0{k+\))) 

< VM{x{o{k))) + VM{x{o{k+l))) < 2VN{x{o{k))) 



where we have used ( [T9| ) in the last inequality. Hence, we obtain the estimate V/v(x^^^^^(/i)) < 
2P{Vn{x), [(p(n)/m*J) which implies 

< afi(2p(yivW,L'PW/m1)) 

< af i(2p(5^(a2(||^||A)), L(«-m*)/m*J)) 



and thus asymptotic stability with ^^-function given by, e.g., P{r,n) = (2p (5/^(052 ('')), L("~ 
m*)/m*\)) + re-'\ □ 
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Remark 4.3. ( i) For the "classical" MPC case m* = \ and /3 satisfying ([8]) it is shown in [6^ Theorem 
5.3] that the criterion from Theorem 4^is tight in the sense that if a* <0 holds then there exists a 
control system which satisfies Assumption \3.1\ but which is not stabilized by the MPC scheme. We 



conjecture that the same is true for the general case m* > 2. 



(ii) Note that in Theorem 4.2 we use a criterion for arbitrary but fixed mEM in order to conclude 



asymptotic stability for time varying mi G M. This is possible since our proof yields as a common 



Lyapunov function for all m&M, cf. also [12 Section 2.1.2]. 



5 Calculation of a^^ 



In this section we continue the analysis of Problem 3.6 in the extended version ( [17] ), i.e., including an 
additional terminal weight. Although this is an optimization problem of much lower complexity than 
the original MPC optimization problem, still, it is in general nonlinear. However, it becomes a linear 
program if /3(r,n) (and thus Bi^{r) from (|9])) is linear in r. 



value oc^ „^ as 



Lemma 5.1. Let [i{r,t) be linear in its first argument. Then Problem 3.6 yields the same optimal 

(21) 



N-2 

min ^ A„ + cqAat-i — V 
Xq,X\,...,Xj^^\,v 



subject to the (now linear) constraints ( ]_3), (14) with BMik) from (\6) and 

111— 1 



Ao,...,Aa?-i,v > 0, ^ A„ 



1. 



(22) 



For a proof we refer to [[6| Remark 4.3 and Lemma 4.6], observing that this proof is easily extended 
to CO > 1. 

Proposition 5.2. Let /3 (•, ■) be linear in its first argument and define Yk := B^ir) / r. Then the optimal 



value of Problem 3.6 equals the optimal value of the optimization problem 



min l-(T^„+i-£t))AA^_i 
subject to X = ( Ai , . . . , Aa^- i ) ^ > componentwise and the linear constraints 



m-l N-2 

A„ + A„ + (0 < Ta' - 1 

n= 1 n=m 

N-2 

Y^K~7N-j Xj + (o < 

N-2 

^ A„ — jN-j+m Xj + ym+l^N-i < 
n=j 



{j= l,...,A^-2) 
(;= m,...,A^-2). 



(23) 
(24) 
(25) 



Proof. We proceed from the linear optimization problem stated in Lemma 5.1 and show that Inequal 



ity ( [14] ), j = N — m — 1, is active in the optimum. To this end, we assume the opposite and deduce a 
contradiction. Aa^-i > allows - due to the continuity of B^+i {^n-i) with respect to Xn-i - for re- 



ducing this variable without violating Inequality ( [T4[ ), j = N — m—\. As a consequence the objective 
function decreases strictly whereas all other constraints remain valid. Hence, = holds. Since 



Xn-2 < Bm+2{XN-2) Inequalities ( [T4[ ), j = N — m — 2, and ( [13] ), k = N — 2, hold trivially. Analogously 
to /W-i > we show = 0- Iterative application of this observation provides A,„ = . . . , = 0. 
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But then the right hand side of ([14]), j = N 
V > - leads to the claimed contradiction. 



m 



1, is equal to zero which - in combination with 



This enables us to treat Inequality ( [T4| ), j = A'^ — m — 1, as an equality constraint. In conjunction 
with the non-negativity conditions imposed on A^, . . . , Aa?_i this ensures v > 0. Moreover, Aq > 
is satisfied for all feasible points due to Inequality ( [T3| ), k = 0, and the linearity of B/^. Next, we 

A'^ — m — 1 , in order to eliminate v and Aq from the considered 

1 converts the objective 



utilize Equalities ( [22] ) and ( [14] ), j = is —m 
optimization problem. Using these equalities and the the definition of 7^ 



function from Lemma 5.2 into the desired form. Furthermore, Equality ([22]) provides the equivalence 
of Inequalities (|T3]), k = 0, and ([23]). Taking Equality ([T4|), j = N — m — I, into account yields 



N-2 



^ A„ + Y,„+ 1 Aa^_ 1 — YN-jKi+ < 



n=m+ J 



for ( 14), j = 0, . . . ,N — m — 2. Shifting the control variable j shows the equivalence to (25 ), j 



m, . . . ,N — 2. Paraphrasing ( 13 ) provides (24) for = 1, . . . , A^ — 2. 



□ 

Before we proceed, we formulate Problem ]5.3] by dropping Inequalities (|24]), j = m, . . . ,N — 2. 



The solution of this relaxed (optimization) problem paves the way for dealing with Problem 3.6 



Problem 5.3. Minimize 1 — (7^+1 — O)) ^n-i subject to A = (Ai, . . . > componentwise and 

AA < b, where 





/ ai 


a2 


■ ■ ■ a^-i 


CO 






/ 


Yn- 


1 \ 




di 


1 


1 


bi 













A : = 





d2 








and b : = 














1 


bN-3 















V 




d^-i 


bN-2 


J 




v 





/ 



with 



a. 



Yn for j <m 
1 otherwise 



(D for j < m 
Ym+i Otherwise 



dj 



-Yn 
Yn 



j+m 



for j <m 
otherwise 



Theorem 5.4. Let /3(-, •) be linear in its first argument and satisfy ([8]). Then the optimal value cc ~ 



in of Problem 3.6 for given optimization horizon N, control horizon m, and weight CO on the final 



term satisfies OC^^ = 1 if and only ifco> Ym+i- Otherwise, we get 



a 



'N,m 



1- 



(Yn+i-co) n n (Y-K 

i=m+2 i=N—m-\-i 



N 



n Y-{Ym+\ 
i=m+ 1 



CO 



N 

n iY 

i=m+2 



r 



N 

n Y 

i—N—m+l 



N 

n {Y-y. 

i=N—in+l 



(26) 



Proof. We have shown that the linear optimization problem stated in Proposition ]5. 2] yields the same 



optimal value as Problem 3.6 for ^=Sfo-functions which are linear in their first argument. Techni- 
cally, this is posed as a minimization problem. Taking the restriction Aa^ i > into account leads 
to the determinable question whether the coefficient of Aa^-i is positive or not. As a consequence, 
the aim is either minimizing or maximizing X^-i- In the first case, i.e., Ym+i — CO < 0, choosing 
Xi — ... = Aa^-i = solves the considered task and provides the optimal value = 1. 



In order to prove the assertion we solve the relaxed Problem 5.3 and show that its optimum is also 
feasible for Problem 3.6 Suppose that A^+i — CO > holds, then Lemma 10.4 shows the optimum's 
crucial characteristic to satisfy the linear system of equations AA = b with A and b from Problem 
5.3 We proceed by deriving formulae for Xn-2j ■ ■■ depending (only) on Aa/_ i . These allow for an 
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explicit calculation of Aa^_i fromAiA =bi. To this end, define 5,- := —di > and begin with showing 
the equality 

^N-l-i = i^JV^^ + ^N-l-j)/ Sn-I-J^ Ym+l^N-l/SN-l-i (27) 

for i = 1 , . . . , A'^ — 1 — m by induction which is obvious for / = 1 . Thus, we continue with the induction 



step using Lemma [KO 



1 



i-1 



k=l 



lA. Jm+l^N-l 



(-1 



ll;=l<'A'-l-;*:=() \;=1 j=k+l , 



k=l 

(33) rm+lU'j=\ii + 5N-l-j) 



k=\ Y\)=\ ^N-i-j 



A, 



Similarly, in consideration of < |33] ) applied with N — I = m one obtains the representation Xm-i 



Wj=\i'^ + Sm-j)/S,n-jj {coXn-i +Y,j=m^j)/^m-i for z = 1 , . . . , m - 1 . We cousidcr the left hand 
side of AiA = bi: 



m— 1 

E 



N-2 



i=m 7= 1 



E 

!=1 



i-nrJili+^A'-i-;) 



;=1 nj=l5A'-l-7 



,inp\(i+^n-,) 



+ 



^-i-np\(i+5A,_i_,) 

Tm+l 2- ^ZZ^ ^ + « 



;=1 



i;=i JW-l-j- 



A, 



V ti n;=i (rm+i+,; - 1 ) y ti n (r^-m+j - 



Aa?-i 



+ 



V-i n'/=l 7ra+l + 7 

^'"^^ ^ n' fr , ■11 +"' 

/=1 llj=l(,7m+l+j - ij 



A, 



The common denominator of this expression is H/L/ "^(7m+i+/ — 1)11/1/ (TAf-m+z ~ 1) which is 
equal to n;Lm+2('K ~ ^)T\^=N+\-m^yi ~^)- Thus, the nominator equals Aa^-i with the coefficient 

, N N i-\ N m-l /(-I m-1 \ N-l 

(« n - 1) + rm+i L n n (r; - 1) ) (r^ i n yN-,„+j n (riv-»,+; - 1) + n - 1)) 

(=m+2 (=m+27=m+2 ./'=(+l '=1 \y=l- ./'='+l / /=A'— m+1 



nt„+2i^-nL„+2(i^-i) 



where we used ([33]) from Lemma 10.2 with d^-i-j = YN-m+j — 1- Hence, taking the coefficient 
(Ym+i — (o) of Ayv_i in the objective function and = 7v — 1 into account, we obtain formula ([26]) as 



the optimal value of Problem 5.3 



However, the assertion claims this to be the optimal value for Problem 3.6 as well. In order to 
prove this it suffices to show that the optimum of Problem |5.3| satisfies the Inequalities ( [24] ), j = 
m. . . ,N — 2. As a consequence, it solves the optimization problem stated in Proposition 5.2 which 
is equivalent to Problem 3.6 As a byproduct, this covers the necessity of the previously considered 
condition Ym+i — W < in order to obtain a^^^^ = 1. 

We perform a pairwise comparison of Inequality ( [25] ) and ([24]) for j E {m, . . . , A'^ — 2} in order to 
show that the Inequalities ( 124] ), j = m, . . . , — 2 are dispensable. To this end, it suffices to show 

(Tm+l - «) AyV-1 > (YN-j+m " YN-j)^j j = m,...,N ~2. (28) 
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Equation ([27]) characterizes the components Xj, j = m, . . . ,N — 2, in the optimum of Problem 5.3 by 

n,...,N — 2. Using 



means of the equation (^nil„,^i"'(T^' " 1) j = Tm+i [Yti=„i+2 ' Ti) ^N-i, j = m,.. 
this representation Xj which (only) depends on A^^-i Inequality ([28]) is equivalent to 



N—j+m 

(Ym+i - n - 1) ^ (TN-j+m 

i=m+2 



N—j+m— 1 



7 = m,...,A^-2. 



Since the left hand side of this expression is equal to 



(7„+i-co) Yl (T^--1)(co-1) + (]^«+i 



'N-j+m-2 
«=1 



(co - 1) > 0, and (YN-j+m - Yn-j) 
for = 1 completes the proof. 



Lemma 



10.1 



applied 

□ 



Remark 5.5. If condition 



is not satisfied the (X^ ^-value which has been deduced in Theorem 



5.4 



may still be used as a lower bound for the optimal value of Problem 3.6 for J(f ^ Q-functions which 
are linear in their first arguments, cf. Corollary 6.1\ 

At first glance, exponential controllability with respect to the stage costs may seem to be re- 
strictive. However, since the stage costs can be used as a design parameter, cf. [6, Section 7], this 
includes even systems which are only asymptotically controllable. In order to illustrate this asser- 
tion we consider the control system defined by x{n + 1) = x{n) + u{n)x{nY - which is the Euler 
approximation of the differential equation x{t) — u{t)x{t)^ with time step 1 - with U = [—1,1] on 
X — (—1,1) C ]R{^ This system is asymptotically stabilizable with control function u{-) = — 1, i.e., 
x{n + 1) = x(n) —x{n)^. However, it is not exponentially stabilizable. Defining 



l(x(n),u{n)) :=e ^^W' 

for < ||.'c(n)|| < 1 and l{x{n),u{n)) := ||x(n)|| otherwise allows for choosing P{r,t) = re^'^'^, i.e., a 
^=Sf -function of type ([6]). We have to establish the inequality 



l{x{n + l)) = l{x{n)-x{nf)=e Mn)Hi-4n)^? <e-H{x{n)) 
which implies Assumption |3 . 1 1 inductivly and is equivalent to 



\>2x{nY{l-x{nYY + {\-x{n)Y = l-3x{ny + 2x{nf. 

Since ||x(n)|| < 1 this inequality holds. Thus, we have obtained exponential controllability with 
respect to suitably chosen stage costs. 



Remark 5.6. Note that Assumption 3. 1 is not merely an abstract condition. Rather, in connection 



with Formula ( [26] ) it can be used for analyzing differences in the MPC closed loop performance for 
different stage costs /(■,■) and thus for developing design guidelines for selecting good cost functions 
/(■,■). This has been carried out, for instance, for the linear wave equation with boundary control 
in for a semilinear parabolic PDE with distributed and boundary control in ^ ( see also /[6|/ for 
a preliminary study), and for a discrete time 2d test example in /j6]/. 



^The state and control restrictions are necessary to preserve the characteristics of the continuous time system for the 
Euler approximation. 
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6 Characteristics of a^^ depending on the optimization horizon 



Theorem 



5.4 



enables us to easily compute the performance bounds oc^ which are needed in Theorem 
4.2|in order to prove stability provided /3 is known. However, even if /3 is not known exactly, we can 



deduce valuable information. The following corollary is obtained by a careful analysis of the fraction 



in (26). 



Corollary 6.1. For each fixed m, /3 of type (|6]) or Q and 03 > I we have YimM-^a=OC^ „^ =1. In 



particular, for sufficiently large N the assumptions of Theorem \4.2\ hold and hence the closed loop 
system is asymptotically stable. 

Proof Since /3 (r, n) is summable, i.e., Er=o ^ ('"' ") < °°' there exists an index m such that (O Y.n=m < 
e < 1. It suffices to investigate the case Jm+i — (0> because otherwise the assertion holds trivially. 



We have to show that the subtrahend of the difference in formula ( [26] ) converges to zero as the op- 
timization horizon tends to infinity. To this aim, we divide the term under consideration into two 
factors. One of them is the following which is bounded for sufficiently large A'', i.e., N > rh + m. 



n 



11 



< 



"j(7m + e-l; 



i(T^'-I) 'm{rm-{(0- 
Hence, we focus on the other factor, i.e., 

irm+i-(o)iC+2iri-'^) 



l)cm-(7m-(w-l)c^ + e-l)) l-£ 



n^+i Yi 



<^ oo. 



Um+iri-{rm+i-a))iC+2iYi 



1) 



rim+l Yi 



(rm+i-a»)n: 

Ym+l 



iiY-K 



CO + {Ym+l -co) 



n; 



m+2 ' 



1. 



Showing the convergence of this term to zero for A'^ tending to infinity completes the proof. Thus, 
it suffices to prove 11^+2 " ^)/Yi — ^ for A'^ tending to infinity. Taking into account — (co — 
^)cm<Yi for all i > m, we derive the desired convergence by the estimate 



n 

m+2 



Yi 



< 



n 



Yi-'^ f Ym-{G)-l)cm + £-l 



Yi 



Ym 



f«-i: 



0. 



□ 

Corollary 6.1 ensures stability for sufficiently large optimization horizons A^ which has already 
been shown in [|5| under similar conditions (see also [ 1 1 1 for an analogous result in continuous time). 
Our result generalizes this assertion to arbitrary, but fixed control horizons m. Furthermore, similar 



to ]10[ for ft) = 1, it also implies that ioxN —f <^ the infinite horizon cost VJo'^''" will converge to the 



< V/v from Theorem 



3.5 



and the obvious inequality 



optimal value Ko (using the inequality 
Vn < for £0 = 1). 

However, compared to these references, our approach has the significant advantage that we can 
also investigate the influence of different quantitative characteristics of j8, e.g., the overshoot C and 
decay rate o in the exponentially controllable case ([6]). For instance, the task of calculating all pa- 
rameter combinations (C, o) implying a nonnegative OC^ ^ and thus stability for a given optimization 



horizon A'^ can be easily performed, cf . Figure 1 ' 



rem 



As expected, the stability region grows with increasing optimization horizon A''. Moreover, Theo- 
5.4|enables us to quantify the observed enlargement, e.g., doubling N = 2 increases the considered 



area by 129.4 percent. Furthermore, we observe that for a given decay rate o there always exists an 



overshoot C such that stability is guaranteed. Indeed, Theorem 5.4 enables us to prove this. To this 



end, we deal with the special case C = 1 exhibiting a significantly simpler expression for a 



(0 

•Njn- 



The idea to visualize the parameter dependent stability regions in this way goes back to |21). 
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a < 




Figure 1: Illustration of the stability region guaranteed by Theorem 5.4 for various optimization 
horizons N given a J^^-function of type ([6]) for "classical" MPC, i.e., m = 1. 



Proposition 6.2. Let the ^ Q-function be of type (|6]) and C = 1. Then the optimal value 0C^„^ is 
equal to min{l, 1 - (1 +aco- (o)a^^^} > 0. 

Proof. We define the auxiliary quantity rj := I + ao) — O). Then, we obtain the equalities 'K = (1 — 

T](l -a'")/(l - cj). Thus, the 



CO 



77a' ^)/(l - a), -y;- - 1 = a(l - 77a' ^)/(l - a), and jm+i 
necessary and sufficient condition (Ym+i — CO) < from Theorem |5.4| holds if and only if T] < 



Hence, we restrict ourselves to rj > and the right hand side of formula ( 26 1 is equal to 



l-a IW2 1-C7 llN-m+1 i-a 



'N,m 



n 



N l-g'~': 
m+1 l-a 



(l-g"')?7 pr/v g(l-g'-2??) 
l-a i.hn+2 i-a 



T](l 



l-g'~'l? 



l-g'-2T7) \ 

1-g ; 



((l-a'^->T])-T](l-a'")a- 



((l-a^-iT7)-(l-a 



T,)a" 



^i-g-^ 



^i-g™ 



1 -T]a 



where we have omitted the control index. 



□ 



3.6 



does not depend on 



Remark 6.3. Note that the optimal value cc^f„, i.e., the solution of Problem 
the control horizon mfor C = 1. Consequently, the control horizon m does not play a role for this 
special case. 



Proposition 



6.2 



states that we always obtain a strictly positive value Cl^ „^ for C = 1. Due to 
continuity of the mvolved expressions this remains true for C = 1 + £ for sufficiently small £. Thus, 
for any decay rate a G (0, 1) and sufficiently small C > 1 (depending on A^, m and (O) we obtain 
m ^ ^ ^'^^ ^^^^ asymptotic stability. However, this property does not hold if we exchange the roles 
of o and C, i.e., for a given overshoot C > 1 stability cannot in general be concluded for a sufficiently 
small decay rate a > 0. 

Next, we investigate the relation between 7 = E;T=o '^n and the optimization horizon for finite 
time controllability in one step, i.e., for a ^^o-function of type Q satisfying ([8]) defined by cq = 7 
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and c„ = for all n G N>i. For this purpose, let 7 be strictly greater than tt) > 1. Otherwise Theorem 



5.4 provides OC^ ,„ = 1 regardless of the optimization horizon N. In this case, Formula ([26]) yields 



We aim at determining the minimal optimization horizon guaranteeing stability for a given param- 
eter 7. In order to ensure stability, we have to show a®,^ > 0. We begin our examination with the 
smallest possible control horizon m = 1. This leads to the inequality 

^co _ 1 (y- ^)(y- If _ f-' - (7- co){r- if-^r ^ ^ 

7^-1 - (7- (0) (7- 1)^-2 7^-1- (7- £o)(7- 1)^-2 - 
Since the logarithm is monotonically increasing this is in turn equivalent to 

- In7-ln(7-l) 
We show that /(y) tends to 7ln 7 asymptotically. To this end, we consider 

fir) 2 in(7-(o) i 7(7-1) 

lim = lim + lim ^ ■ lim = lim ^ - ' 



y->ooyin7 y-^°°7ln7 y-^-°° ln7 r-^°° ln7— ln(7— 1) 7-^°° 72 



=0 =1 



where we have used L' Hospital's rule. Clearly, ceiling the derived expression for the optimization 
horizon doesn't change the obtained result. 

We continue with analysing the coherancy between 7 and for control horizons m which provide 
the largest optimal value, i.e., m = [N/2\, cf. Section jvj below. Analogously, (X^ ^j^/2\ — ^ ii^duces 



lower bounds 



"21n ( ^^y ^ ) /(ln7-ln(7- 1)) for even 

(in (^) +ln (?^)) /(ln7-ln(7- 1)) for odd A^ 



for the optimization horizon N. Again in consideration of L'Hospital's rule, the investigated expres- 
sion exhibits asymptotically a behaviour like 2 In 2 ■ 7, cf. Figure [2j Since the obtained approximation 
21n2 ■ 7 holds for both estimates corresponding to even and odd natural numbers N for m= [A^/2J , 
we have illustrated the resulting horizon lengths for given 7 with respect to both. Moreover, these 
estimates coincide with the numerical results derived in [6, Section 6]. 

Remark 6.4. As a consequence ofLemma \5.1 it follows that these estimates provide upper bounds for 
the minimal stabilizing horizons for J^^Q-functions j8(-, ■) which are linear in their first argument 
and satisfy ([8]), e.g., for cq = 7 = CY,n^Q o" with C > 1, a e (0, 1). 



7 Qualitative characteristics of depending on varying con- 
trol horizon m 



In the previous section we have investigated the influence of the optimization horizon A^ on the op 
of Problem 



timal value cc^ym 



3.6 



in the extended version. E.g., we have proven that Theorem 



5.4 



ensures stability for sufficiently large optimization horizons A'^. Thus, choosing A^ appropriately re 

4r2lassumes the positivity of 



mains crucial in order to obtain suitable a® ^^-values. However, Theorem 
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Figure 2: Minimal stabilizing optimization horizons for one step finite time controllability for m— I 
and m = [N/2\ in comparison with their asymptotic approximations. 

several a^^^^-values with different control horizons m. Section [6] already indicated that, e.g., the min- 
imal stabilizing horizon depends sensitively on the parameter m. Thus, the question arises whether 
changing the control horizon persistently causes additional difficulties in order to guarantee stability. 

Before proceeding, we state results concerning symmetry and monotonicity properties of the opti- 
mal value OC^ ,„ with respect to the control horizon m. These results - which are proven in Subsections 
7.1[|7.2| - do not only pave the way to answer the asked question but are also interesting in their own 



rights. 

Proposition 7.1. Let /3 be of type ([6j) or of type Q with Cn — Ofor n>3. Then a^^ < OL^ f^_,^ holds 
forme{\,...,[N/2\},N en,and(0>\. 

Proposition 7.2. Let /3 be of type ([6j) and CO G {1} U [1/(1 - C7),oo) or of type Q with Cn = Oforn> 2 
and (0 > 1. Then > a^^^ holds for me {I,..., [N/2\ -l},NeK 

These symmetry and monotonicity properties have the following remarkable consequence for our 
stabilization problem. 

Theorem 7.3. Let /3 be of type @ and (0 e {1} U [1/(1 - a),oo) or of type Q with Cn = Oforn > 2. 



Then for each N >2 the stability criterion from Theorem 4.2 is satisfied for m* = N —\ if and only if 
it is satisfied for m* — I. 



Proof. Proposition 
In other words 



7.1 



and 



7.2 



imply OC^ ,„ > OC^ j for all m G M which yields the assertion. □ 
Tor exponentially controllable systems without or with sufficiently large final 
weight and for systems which are finite time controllable in at most two steps, we obtain stability for 
our proposed networked MPC scheme under exactly the same conditions as for "classical" MFC, i.e., 

is 



1. In this context we recall once again that for m* = 1 the stability condition of Theorem 4.2 



tight, cf. Remark 4.3 



7.1 Symmetry Analysis 

In this subsection we carry out a complete symmetry analysis of the optimal value ct^^ given in 



Theorem 5.4 with respect to the control horizon m. To this end, we distinguish the special case 
(0 = 1 from £0 > 1, i.e., the szenario including an additional weight on the final term. The following 
symmetry property for co = 1 follows immediately from Formula (|26l). 
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Corollary 7.4. For m= 1, . . . , [yj the values from Theorem ( |5.4[ ) satisfy a)^ = ^ 



Depicting the corresponding -values for some J^=Sf o-functions, Fig. [3| illustrates the asser 



tion of Corollary |7.4[ In addition, we observe that increasing the control horizon improves the optimal 
value Ofyy^j quantitatively. Hereby, Figure [3] shows the interaction between symmetry and monotonic- 
ity properties which is essential for the proof of Theorem 7.3 Moreover, adding an additional weight 
on the final term may lead to a further improvement of the guaranteed stability behaviour. But instead 
of the equality Oi}] „^ = CtyvA^-m we observe the inequality Oi^ ^ < OL^ for the setting including an 
additional weight on the final term for =j^^o-functions which are linear in their first argument and 
satisfy ^ 




6 7 8 



Figure 3: We consider a ^^-function of type (|6]) with parameters (C, o) = (2,5/8), i.e., exponential 
controllability, and a ^^o-function of type (|7]) satisfying ([8]) defined by cq = 1, ci = 5/4, C2 = 
3/2, C3 = 5/4, C4 = 1/2, C5 = 1/4, and cs = 1/16, i.e., finite time controllability (*,o). On the left we 
have illustrated the corresponding -values. On the right we have depicted the same functions with 
final weights, i.e., ft) = 5/4, 2 for the exponentially stable case and (0 — 2 for finite time controllability 
(*,o,o). 

In the remainder of this subsection we prove Propo sition |7 . 1 1 and demonstrate that a generalization 
including ^=Sf o-functions of type (|7]) not satisfying the given assumptions is not possible. Conse- 
quently, we aim at establishing a®^^^ < oc^ for ft) > 1. Note that, if the necessary and sufficient 
condition Ym+i — CO <0 holds, then Formula ([26]) solely provides values 0C^„^ greater or equal one. 
Thus, showing the desired inequality using the expressions provided by Formula (|26]) covers the as- 



sertion in the absense of the condition y^+i — ft) < 0. Hence, ccj^j^^,^ — a^^^ > is equivalent to 

N N 
(7A'-m+l-l)(7m+l-W) Y[ Yi - (YN-m+l - CO) ]J ~ 

i=N-m+\ i=N-m+2 

' N N 1 " 

n Y'- n 



N N 

n n (T^-i) 

i=m+i 



i=m+ 1 



> (7/ 



W-m+l 



«)(7 



m+1 



N N 

n 7-(7m+i-w) Y[ (7-1) 

i=m+ 1 i=m+2 



N 

n 

i=N-m+l 



N 

n 

i=N-m+\ 



Expanding these terms and reducing by (ft) — 1) > leads to 

N-m N N N 

Yl Yi II (7-l)(7v-m+i-w) + (7m+i-7w-m+i) fl 7 " (7m+i " «) (7-l)>0. 

!=m+l i=N—m+\ i=m+\ i=m+l 



(29) 



These preliminary considerations enable us to derive results referring to the above mentioned symme- 
try property of ajy with respect to the control horizon m. First, we assume finite time controllability. 



This case is completely characterized by Lemma 7.5 and Remark 7.6 
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Lemma 7.5. Assume that the ^ Q-function is of type ^ satisfying ([8]). In addition, let cq, ci, C2>0 
and Cn = Ofor all n G N>3. Then Ct®yy_,„ — a^y „^ > holds for m< N — m, m,N eN. 



Proof. We show that assuming fm+i — w < implies fN-m+i — O) <Ofor m < N — m. Since y^+i = 

Ln=icn + COC,n the 

0. Then it follows 



Y.n=o + the assertion holds for m > 2. Thus, we restrict ourselves to m = 1 , i.e., cq + ciCO — Q) < 



7N-m+l — (0 < Co + Ci +C2(0 — W + CiCO — CiCO < {cq + CiQ} — co) +ci{co + Ci(0 — co) <0. 



This covers the case Ym+i — (O < 0. Hence, we assume Ym+i — (O > 0. Note that Corollary 7.4 



shows the assertion for CO = 1 . Thus, we restrict ourselves to the case ft) > 1 . Moreover, we suppose 
YM-m+i — CO > because otherwise OCf^ = 1 and the assertion holds trivially. We make a case 
differentiation with respect to m. For m > 2 we have Ym+i = YN-m+i- Thus, (|29]) is equivalent to 



N 

{Ym+i -co) Yl {y 

i=N—m+l 



N—m N—m 

n r.- n ir.-r 

7=ra+l i=ra+l 



>0 



implying the assertion. For m = 2 we obtain Ym+i = B = + ci + COC2 and YN-m+i = En=o'^«- 
Consequently, {Ym+i - YN-m+i) = {co - l)c2 and (Ym+i - ft)) = (ft) - l)c2 + (YN-m+i - co) holds. 
Using these expressions for the corresponding terms in ([29]) provides OC^f^_^ > OC^^. For m = 1 we 
have Ym+i = Y2 = co + coci and YN-m+i = Yn- Thus, ([29j) is equivalent to 

N-\ N-l 

iY2iYN-l){YN-C0) + {Y2-YN)Y2YN)Ylr'-(iy2-C0){Y2-i){YN-i))Yl(ri-'^)^^- 

i=3 i=3 

We show that the coefficient of H/ll^ Y is positive, i.e., Y2{Yn{Y2 - ft) - 1) + ft*) > 0. To this end, it 
suffices to investigate the case 72 — ft) — 1 < 0. In consideration of ([8]), we estimate this expression as 
follows 

Y2[Yn{Y2-C0-1)+CO] > 72[(co + Ci+Cift))(co + Cift)-ft)-l) + ft)] 

= 72[(co- l)(co + cift)-ft) + ci)+cfft)(co + cift)-ft))] >0. 

Hence, it suffices to show that the coefficient of Ylf=3 Yi greater or equal than the coefficient of 
H/L^H?!' ~ !)• This leads to the inequality 72(72 — 1) — a){YN — 1) > 0. Here, we estimate Yn < 
C0 + C1 + ft)C2 and obtain ft)^(cj — C2) + (cq — l)(co + cift) — ft) + cift)) which holds according to the 
assumptions 72 — ft) > and ([8]). □ 

Remark 7.6. Note that Lemma 7.5 does not hold for arbitrary ^ ^-functions of type (|7]) which 
satisfy ([8]). Consider, e.g., cq = 1, ci = 3/2, C2 = 2/3, C3 = 1 and Cn = Ofor n>4. For N = 5 and 
m — lthe necessary and sufficient condition for = 1 satisfied for ft) > 15/2, i.e., 72 — ft) < 0. 

However, it holds Tv-m+i — ft) = E^^o'-'i ^ ^ which implies < 1 = a^2- 

In the sense of Remark 7.6 the assertion of Lemma [73 is strict. Hence, the deduced results only 
hold for a subset of the class of finite time controllable systems which satisfy ([8]). In contrast to that, 
we are able to derive much more general results for the exponentially controllable case. To this end, 
assume that the ^^o-function is of type ([6]). We begin our analysis with the case Ym+i — C0<0, i.e., 
^Nm ~ 1- This condition guarantees the preservation of the symmetry property stated in Corollary 



7.4 



and implies ~ = 1 for all m G {m + 1 , . . . , — 1 }. 



Lemma 7.7. Let the J^^o-function j8 be of type ([6]). Then Ym+i — ft) < implies Yfh+i — CO < Ofor 
allmE{m+l,...,N- 1}. 
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Proof. We have Jm+i — CO = T!nZo c„ + (c^ — 1 ) W < which implies Cm = Co'^ < 1 and is equivalent 
to (0 > C( 1 — a'") / ( 1 — c) ( 1 — Co'") > 1 . Thus, it suffices to establish the following inequality based 
on the obtained estimate for co: 



Ym+l -03< 



Cfl 



(l-a)(l-Ca" 



(l-CCT'") <0. 



The second inequality is equivalent to (C — l)a"' < (C — l)^"' showing the assertion for m> m. □ 
Proposition Ojand Lemma TTJenable us to carry out a complete symmetry analysis of the optimal 



values obtained in Theorem 5.4 (for a proof of the following lemma we refer to Subsection 10.2). 
Note that we do not distinguish whether an additional weight on the final term is included and do note 
impose any restrictions with respect to the considered ^=Sf -functions. 

Lemma 7.8. Let the J^^o-function /3 be of type Then — a® ,„ > holds for m<N — m, 

m e N>o, e N>3. 



7.2 Monotonicity Properties 



Apart from the symmetry proven in Corollary |74 and its generalized counterparts for the szenario 
including an additional weight on the final term, cf. Lemmata 7.5| and [7^ one also observes a certain 
monotonicity property: we have Ct^„_|_i > for m = 1, . . . , [N/2\ — 1. This is a very desirable 
feature because it implies - in combination with the derived symmetry results - that if the stability 

1 then is also holds for all m* < N — I, cf . Theorem |7.3 



condition in Theorem 4.2 holds for m 



However, the next example shows that this monotonicity property does not always hold. 

Example 7.9. We consider the ^ Q-functions j8i and P2 of type Q defined by cq = 1.24, ci = 
1.14, C2 = 1.04 and c,- = Ofor all i > 3 for j8i and cq = 1, ci = 1.2, C2 = 1.1, C3 = 1.1, C4 = 1.2, C5 = 
1, cg = 0.75, C7 = 0.25 and Ci = Ofor all i > Sfor ^2- Both functions satisfy condition ([8]) and /3i is, 
in addition, monotonically decreasing. The corresponding values a}^ ^ in Fig. |4] show that neither 



function satisfies a 



>a},^^form=l,...,[N/2-l\. 





Figure 4: Visualization of the corresponding al^, m = \, . . . ,3 values for /3i (on the left with co 
1, 1.01) and al^,m= 1, . . . , 8 for J82 (on the right with (O = 1,4/3) from Example 7.9 



Example 7.9 shows that the desired monotonicity property does not hold for arbitrary ,J^^q- 
functions /3 . However, the following lemmata show that monotonicity holds for /3 of type ([6]) and at 
least for a subset of /3 of type (|7]). First, we adress monotonicity properties with respect to the control 
horizon m for ^=Sfo-functions of type (|7]). More precisely, we aim at establishing 



CO 



1 — "A'.m- 



As seen in Example 7.9, even in the setting without an additional weight on the final term it is not 
possible to prove this inequality for arbitrary J^^o -functions of type Q. Thus, the following lemma 
gives a complete analysis. 
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Lemma 7.10. Assume that the J^^o-function ^ is of type Q. In addition, let cq, ci > and Cn = 
for all n G N>2. Then OC^ — OC^m — ^ holds for m G {1, • • • , [N/2\ — 1} in consideration of 
condition dSl). 



Proof. Since Ym+i > Ji for all / G N>3 we assume w.l.o.g. Jm^x — (0 > 0. Thus, we use Formula 26 
show the assertion. Then, cuj^,„+i — OJj^m > is equivalent to 



to 



(7^+1 -w)(7,„+2- 1) 

(7m+2-ft))(7A'-m- 1) 



(30) 



n T^--(7m+2-co) W (7-1) 

!=m+2 i=m+3 
A? N 

n 7-(7m+i-«) n (t^'-i) 

i=m+ 1 i=m+2 

Note that 73 = 7;- holds for all i G N>4 which implies 7^+2 = ?5v-m- Thus, the inequality in consider 
ation simplifies to 



n n (T^-i^ 

i=N—m i=N—m 
N N 

n ri- n (T^-i^ 

i=N-m+\ i=N-m+\ 



>0. 



w(rm+i-rw-m) n ^' 



N 



>0 



n n (T^-i; 

!=A'— OT+l i—N—m+\ 
N—m 

+ Yl (y-^) Yl YiiYm+i-o}) 

i=N—m+l i=N—m+l 

and shows the assertion. □ 
Now, we aim at deriving monotonicity properties assuming exponential controllability. To this 
end, we consider inequality ([30]), i.e., oc^ — Cfj^^, which is in turn equivalent to 



N—m 

n ri-{rm+2-(o) n (i^--!^ 

i—m+3 



!=m+2 



N N-m N N 

-a n yi + {a + {y,„+i-(o){y,n+2-l)) Y\ Yi Y{ [ji - ^) - {jm+i - (o){y,n+2 - (o) n {yi-l)>Q (31) 

/=777+2 /=m+2 /=A'^— 777+1 (=m+2 

witha := -[wr^v-mlrm+i -7m+2) + 7m+i(7m+2-7A'-m) + «(7A'-m-7m+i)]- The foUowing coroUary 
shows the desired monotonicity properties for the exponentially controllable case for final weights 
which are chosen sufficiently large, i.e., (O > {I — a)^^ . 

Corollary 7.11. Let the .J^ ^ ^-function he of type (|6]) and T] := 1 + act) — (0 < 0. Then it holds 
'^N.m+i ~ ^N,m > 0/or m G N>i satisfying 2m + 2<N,Ne N>4. 

Proof Using the equality 7+1 = C(X^^^Qa" + (oa' = C(l - T7C7')(1 - cr)"^ we obtain 



1-C7 



(C - 1 ) wa'" + C7^-™- 1 £o( 1 - Ct] C7'") + 7^+1 (a 



m+l j^A'— ra— 1^ 



>0. 



As a consequnece, the term -aUf=,n+2TiiUf=N-m+i 7i - Uf:=N-m+iiTi - 1)) from ([31]) is positive. 
Since the remaining terms in ([3T]) are also positive the assertion follows. □ 



The following lemma deals with the special case N = 2m + 2 and is proven in Subsection 10.3 



Lemma 7.12. Let the ^ Q-function be of type ([6]) and T] := 1 + OO) — CO > 0. Then it holds a 
CCnm > /or m G N>i satisfying 2m + 2 = N, N e N>4. 



CO 

W,m+1 



Assume that pT} holds for A^. We aim at establishing the considered inequality for A'^ + 1 using 
the assertion for as an induction assumption. Moreover, a is defined as above and a stands for the 
same expression with A'^+ 1 instead of A'^. Then, it suffices to show 



A' 



(7iv+i - l)(7«+i - «)(7m+2 - w) n (T^' - 1) 



m+2 



N—m N 

< {rN+i-'^){-aYlri + {a+{rm+i-(o){r,n+2-i))Yly' Yl (t^-i^ 

in+2 N-m+l 



N 

n 

m+2 



N+1 N-m+l N+l 

< -dY[r'+ia+{Y,n+i-(o){r,n+2-i)) Y[ yi Y[ (1^-1^ 

m+2 m+2 A'— m+2 
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where we have omitted the control variable. This in turn is equivalent to 



[(« + (7m+l - W)(7m+2 - l))rA'-m+l " («+ (7m+l " «)(7m+2 " l))(7A'-m+l " 1)] Yl (^^^ ~ 1) 

i=N-m+2 

N 

> (a7iv+i-a(7w+i-i)) n yi- 

i=N-m+l 

Taking into account the following equations 



5+(rm+i-«)(rm+2-i) 

-« - (Tm+l - (0)iYm+2 - 1) 

a — a 
a 



iYN-m+l - '^)iC0Ym+2- COYm+l+Ym+l " «), 
-{YN-m - l)(«rm+2 " (OYm+l + Ym+\ " «), 
(TA'-m+l - YN-nt) {(OYm+2 " a»7m+l + Ym+1 " W), 
7A'-m(a'7m+2 " OJYm+l + Ym+l - (O) - Ym+l {Ym+2 " «)• 



the inequality in consideration is equivalent to 



N+l 



(YN-m+l - (YN-m - 1)) Yl (Y' - > { YN-m+1 - YN-m + 



N-m+l 



YN-m Ym+l (ym+2 " CO) 

Yn+1 YN+l{(0Ym+2 - COYn,+ l + Ym+l - «) 



n ^ 

N-m+l 



(32) 



Lemma 7.13. Le? the J(f ^ Q-function /3 Z^e of type ([6]) anJ £0=1. T/jen Ct^,jj_|_^ — > holds for 
A^GN>4, mG{l,...,[A^/2j-l}. 



Proof. Due to Lemma 7. 12 , it suffices to show inequality ( [321 ) to prove Ct®,„^i > £0=1 implies 
(£07^-1-2 — 0)Ym+\ + 7?!+! — £o) = (7m+2 — 1) and r\ = o. Thus, the right hand side of this inequality 
can be simplified significantly. Using the definition of 7, we obtain the equivalent inequality 



p{C):={C^o 



-(N-m) 



N+l 

' n 

i=N-m+l 



c 



1-C7 
1-C7' 



>C™+1 ( c + 



{I -a 



-■q{c). 



Proposition 6.2 provides p{l) =q{l). Furthermore, note that ;? has exactly one negative root and m+1 
strictly positive roots which are located in the open interval (0, 1). Additionaly, q can be represented 
as C"^^^ {C + c) with c > 0. Thus, the only condition needed to be verified for the application of 
is the one with respect to the (m+ l)^^-derivative. To this end, we have to show the 

A'+l 



Lemma 



10.5 



inequality 



-{N-m) 



El (J KJ W 

1 -cj' ^ n -(jN+l)(jN-m 



which is equivalent to 



1 _ rr™+l ^+1 

— (l + (j^-'") > (l-a^+i)a^-'" 




^ ] — CJ' 



' V- 

<(m+l) 



1 



l^(,N-i"+l 



Hence, the inequality 

(1 _ c7^-'"+i)a'"(l + o^-"') > a'" - a2^"™+^ 
implies the assertion. 



{I -a 



□ 
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8 Quantitative characteristics of a^^ depending on varying con- 
trol horizon m 



.a 



In the previous section we derived qualitative characteristics of the obtained stability bounds ^ 
with respect to the control horizon m, e.g. symmetry or monotonicity properties, which can be ex- 



ploited according to Theorem 7.3 Nevertheless, the decisive question remains whether we are able to 
guarantee stability or not, i.e., whether the sign of the oc^^^^-values corresponding to a given J(^^q- 
function j8 (r, t) is positive or not. Clearly, choosing the optimization horizon sufficiently large 



ensures stability, cf. Corollary 6.1[ On the other hand, enlarging the optimization horizon A'^ implies 



higher computational costs in order to find an optimal control with respect to (|2]). In contrast to that, 
changing the control horizon m or adding an additional weight on the final term does not significantly 
change the effort needed to solve the finite horizon optmization problem induced by (|2]). Hence, we 
aim at analyzing the influence of these set screws more closely. 



8.1 Control horizon 



Assuming exponential controllability, i.e., a ^=Sfo -function of type (|6]), Theorem 5.4 enables us to 
determine the maximal feasible overshoot C for a given decay rate a ensuring stablity, i.e., a positive 
Ctj^^^-value. For simplicity of exposition, we restrict ourselves to the case without an additional 
weight on the final term, i.e., ft) = 1. In order to determine the impact of the control horizon m for a 
given optimization horizon A^, we carefully examine the stability region, i.e., the set of all parameter 
combinations C > 1, c G (0, 1) guaranteeing stability of the underlying discrete time systems. Due 
to the assertion of Corollary 7.4 it suffices to deal with m G {1, . . . , [N/2\ }. Exemplarily, Figure [5] 
shows the stability regions for N = 1 and = 1 1 respectively. 





Figure 5: Illustration of parameter combinations (C, o) ensuring stabihty in dependency of the control 
horizon m for optimization horizons N = 1 and A^^ = 1 1 respectively. 

Apparently, increasing the control horizon m enlarges the stability region, i.e., allows for larger 
overshoots C for given decay rates o. To be more precise, incrementing the control horizon augments 



the area of interest. Here, the monotonicity property according to Lemma 7.13 is reflected. Moreover, 
we are able to quantify this aspect. E.g., for N = 7, the area containing feasible (C, a) pairs is scaled 
up by 21 and 30 percent. For longer optimization horizons increasing the control horizon enhances 
the attainable gain even further, e.g. m = 2 and m = 5 enlarge the stability region by 23 and 48 percent 
respectively. 

As we have seen, the exponential controllable case provides various desirable properties, cf. The- 
orem 7.3 which do not hold for finite time controllability, i.e., ^=Sfo-functions of type ^ satisfying 
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([8]), in general. Still, we expended the effort to give a complete characterization referring to this set- 
ting, cf. Lemmata 7.5 and 7.10 The reason for putting so much emphasis on this is given in the 
following example. 

Example 8.1. Consider the ^ Q-function of type ^ defined by cq = 5/2, ci = 2, C2 = 3/2, C3 = 
32/25, C4 = 1, C5 = 1/2, C6 = 1/8, and ci — Q for all i G N>7. We construct an upper bound by 
choosing C = 5/2 and a = 4/5, i.e., a J(f ^ -function of type ([6]), cf. Figure^on the right. Although 
this seems to be a good approximation, the corresponding -values are significantly worse, cf 
Figure^on the left. E.g., in contrast to the finite time controllable case, stability cannot be guaranteed 
for control horizons m G {2,3,4, 12, 13, 14} using exponential controllability. 

Thus, it is in general favorable to work with a J^=Sfo -function ensuring finite time controllability 
in contrast to using an upper bound provided by an estimated ^^-function of type ([6]). Particularly, 
this is the case since positivity of the needed ct^ . -values can easily be checked by means of Theorem 



5.4 Moreover, note that even for ^=Sfo-functions which do not satisfy the assumptions of Theorem 



7.3[ the assertion with respect to symmetry and monotonicity often holds, cf. Figure [6j 
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Figure 6: Comparison of ttj^g for the ^^o-functions of type (6 o) and (j7|*) respectively. On the 
right we depict the corresponding ^^o-functions. 



8.2 Influence of an additional weight on the final term 

In order to evaluate the benefit provided by a final weight, we discern whether the coefficient is 



strictly smaller than one or not. Since c, 
condition y^+i 



< 1 allows for guaranteeing the necessary and sufficient 



£0 < 0, cf. Theorem 5.4 for sufficiently large ft), adding an appropriate additional 
weight on the final term enables us to ensure stability. Moreover, note that the probability of being 
able to fulfill this condition increases with longer control horizons in general, cf. ^=Sf o-functions of 
type 

However, without this condition being satisfied analyzing the effects of including a final weight 
is much more subtle. Thus, we start our investigation by looking at the following example which 
demonstrates positive effects of adding a final weight to the considered setting. 

Example 8.2. We assume finite time controllability characterized by the coefficients cq = 1, ci = 
3/2, C2 = 39/20, C4 = 7/5, and ci = Ofor all i G N>5 which ensure ([8]). The resulting ocf -values for 
CO = I and ft) = 3/2 are illustrated in Fig. 

At first, note that the generalized symmetry as well as the monotonicity property hold in Example 



8.2 although the assumptions of Lemmata 7.5 and 7.10 are not satisfied (c3, C4 > 0). Furthermore, 
we observe the interplay of adding a final weight and the two mentioned properties. Together, these 
adjusting screws imply our stability condition for m = 4 which is not fulfilled for ft) = 1. 

The next example points out a possible pitfall as well as an adequate approach to overcome it. 
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Example 8.3. Again, we assume finite time controllability, i.e., a Ji(f Q-fiinction of type ^ given 
by Co = l,ci = 3/2, C2 = 2/3, C3 = 1, and ci = 0/or all i G N>4. Note that these coefficients satisfy 
condition ([8]). In Fig. ^we have depicted ocf,^, ni= 1,2,3,4 with several different additional weights 
on the final term. 




Figure 7: aff_ for the ^=Sfo-function from Example 
af corresponding to Example 



8.3 



8.2 



for (0 = 1 (o) and (0 = 3/2 (o). On the right 



for ft) = 1,7/2, ana35/2 (o,*,o). 



Although increasing ft) seems to significantly improve the guaranteed stability behaviour in gen- 
eral, an additional weight on the final term - chosen too big - may even invalidate our stability 
condition, cf. Figure |7j However, in the szenario of Example 8.3 we are able to compensate this 



drawback by shifting to a larger control horizon. Once more, we stress the fact that Theorem 5.4 



allows for easily calculating the a^^^^-values which has to be taken into account. 



9 Example 

In this section we compare our analytical results with numerical MPC simulations. The first example 
is a linear inverted pendulum which is solved for a grid of initial values. The second example is a 
nonlinear form of the inverted pendulum. We use it to show that enlarging the control horizon m 
exhibits a stabilizing effect even for long optimization horizons A^. Since numerical optimization 
for large control horizons appears to be difficult, we added a third example, a nonlinear arm-rotor- 
platform model, which allows us to show numerical results for m=l,...,A^— 1. 



9.1 Linear Inverted Pendulum 

Our first example is a linear inverted pendulum on a cart given by 



in 



in which we want to stabilize the upright position = (0,0,0,0) using linear MPC. Here, we used 
the optimization horizon N = 10, the sampling interval T = 0.7 and the cost functional Jn{xq,u) = 
"LnZo \\Q^u{n)\\i + \\Ru{n)\\i with Q = 2Id and R = 4Id. Moreover, we use the constants g = 9.81 
and k = 0.l for gravitation and friction respectively. 

Since Assumption 3.1 exhibits a set- valued nature we consider a uniform grid ^ of initial values from 
the set [— 0.05,0. 05px [—1,1] x [—0.05,0.05] which contains the origins*. Foreachm= 1,...,9 we 
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simulate the MPC closed loop trajectories ^^^,„ with control horizon m, = m and initial value x G ^. 
Along each trajectory we then compute „^ as the minimum of the suboptimality degrees from 
Formula (|5]) applied with xq = x^^^^{n), n = 0,m, 2m, . . . , 19. A selection of these values is plotted 
in Fig. l8| in which each dashed line represents the values j , • • . , CC^ N-i ^ corresponding initial 
value, m addition, the minima over all trajectories are plotted as a solid line. 




Figure 8: Approximation of afp ^, (O G {1,...,8}, for the linear inverted pendulum. 

The results indicate that the closed loop is asymptotically stable for each m, and confirm that 
choosing control horizons m,- > 1 may indeed improve the suboptimality bound. Moreover, it is 
interesting to compare Fig. [8] with Fig. [3j While Fig. |3] shows the minimal a-values for a set of 
exponentially controllable systems, the curves in Fig.[8]represent the numerically computed a-values 
for one particular system and a grid of initial values. Yet, the curves in Fig. [8] at least approximately 
resemble the shape of the curves in Fig. [3} 

The second part of Fig. [3] treats the enlarged weights on the final term. Comparing the presented 
analytical results to our simulations depicted in the right part of Fig. [8] we obtain the same tendency: 
If the weight on the final term is increased, then the degree of suboptimality a is growing faster for 
small control horizons m. 

9.2 Nonlinear Inverted Pendulum 

In order to show that similar effects can be experienced for nonlinear control problems, we consider 
the presented inverted pendulum on a cart problem in the nonlinear form 

Xi{t) =X2{t) 

^2(0 = -jsm{xi{t)+n) - y.)C2 (01-^2 (01 -u{t)cos{xi{t) + n)-kRSgn{x2{t)) 

X3{t) =X4{t) 
X4{t) = u{t) 

with gravitation constant g = 9.81, length Z = 10 and friction terms kR = kL = 0.01. Again, we aim at 
stabilizing the upright position x* = (0, 0, 0, 0) . Here, we consider the stage cost 

l{x{i),u{i)) := J 10"\(0^+ (3.51 sin(;ci (0)^ + 4.82 sin(jci(0).^2W + 2.31x2(0^ 

ti 

+ 0.1 ((1-COS(JC1(0))-(1+COS(JC2(0)^)) +0.0\X3{tf + 0.\X4{tf] dt 
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which gives us the cost functional 

N-2 

Jn{xq,u) = ^ l{x{i),u{i)) + (ol{x{N-l),u{N- 1)) 

over an optimization horizon N = 10 and sampling length T = 0.05. Moreover, the tolerances of 
the optimization routine and the differential equation solver are set to 10~^ and 10^ respectively. 
Since this cost functional is 2;r-periodic, we add box-constraints limiting X to the interval [—In + 
0.01, 2;r — 0.01]. Using the initial value xo = {7t+ 1.5,0,0,0), we simulated the MPC closed-loop 
trajectories for m = 1 , . . . , 10 and final weights CO = 1 , . . . , 10 with control horizon m, = m. 
Since the numerical optimization is not reliable on start of the NMPC algorithm, a startup sequence 
of 20 NMPC iterations using m = 1 is implemented to obtain an initial guess of the control which 
can be assumed to be close to the global optimum. Moreover, the problem appears to be practically 
stabilizable only. To compensate this issue, we used the estimation constant £ = 10^^, cf. [7, Theorem 
21] for details. 

In Fig.[9[ the minimal a-value along a closed-loop trajectory is shown for a variety of final weights 
CO and control horizons m. 




Figure 9: Approximation of m^^^ {^^ ■ ■ A^}^ for the nonlinear inverted pendulum. 

For this simulation, we were able to increase the range of m from 3 to 20 for which acceptable a 
values can be computed by internally repeating the optimization at every sampling point. This allows 
us to keep track of a suitable initial guess of the control while the system is running in open-loop. For 
m > 21 we experience numerical problems during the optimization and although most of the resulting 
trajectories converge to the target point, we cannot see this from our estimates. 
Note that for ft) = 1 the a values are negative for control horizons m = 1 , . . . , 4. Still, larger control 
horizons exhibit a positive a value such that stability is guaranteed. Additionally, an increase in a 
can be experienced for all control horizons m considered in this example if CO is increased. This 
corresponds to the known stabilizing effect of terminal costs. 

Since computing these estimates can be done with very small additional effort compared to the MPC 
procedure, such an analysis should be done before enlarging the optimization horizon. 
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9.3 Nonlinear Arm-Rotor-Platform Modell 



Last, we consider an arm/rotor/platform (ARP) model: 

Xi{t) = X2{t) + Xe{t)x3{t) 

ki . . bi ^ . , X / ^ mrb 

-—X\[t) - —X2(t) +Xe{t)X4[t) 



X2{t) 
^3(0 
X4(t) 



-X(,{t)xi{t) +X4{t) 

, , , , ki , , bi , , mrki 

-X6{t)x2{t) - -X3it) - —X4{t) + 



-X(,{t) 



X(,{t) = -aixsit) - a2Xf:,{t) + aiXT{t) + a2,xs{t) - Pixi{t) - p2X2{t) 

X']{t) =Xs{t) 

xs{t) = a4X5{t) + a5X(,{t) -a4Xi{t) - {as+a^)x%{t) + ^u{t) 

For details on the specification of the model parameters we refer to [j4| Chapter 7.3.2]. 
For this example, we fix the initial values to x{tQ) = (0,0,0,0, 10,0,0,0), the absolute and relative 
tolerances for the solver of the differential equation both to 10^*^, the length of the open-loop horizon 
within the MPC-algorithm to H = N T with = 13 and sampling period T = 0.05, and set the 
optimality tolerance of the SQP solver to 10^. Moreover, the cost functional is given by 



J{x,u) 



N-2 

j=o Jh 



0+1 9 {^^ 9 

\x{t)\+u{tYdt-^(a \ \x{t)\-Vu{tYdt 



and the practical region of the equilibrium is estimated using the constant £ = 5 ■ 10 ^. Again, we 
used a startup sequence of 5 NMPC iterations with m = 1 to improve the initial guess of the control. 





control horizon 



final weight 



control horizon 



Figure 10: Approximation of a® for the arm-rotor-platform model. 



Similar to Fig. |9| Fig. 10 shows the minimal a-value along a closed-loop trajectory for a variety 



of final weights CO and all possible control horizons m = 1, . . . , A'^. Again, we obtain an improvement 
of our suboptimality estimate if the final weight (O is increased. Considering the control horizon m, 
however, we hardly experience any improvement for small m and a decrease of a for m being large. 
Note that suboptimality estimates which are computed for every sampling instant inherit a different 
weighting of these instants if m is changed. Yet, a fair comparison can be obtained if only those 
control horizon lengths are taken into account which are an integer factor of the largest one and use 



26 



the estimate ([5]). In the left of Fig. 11 we display such a comparison for m G {1,2,3,4,6, 12}. The 
corresponding cost of the closed-loop costs V^^'"' considering the first are shown on the right of Fig. 
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It exhibits the expected decrease in CO, but also the rise in m. Moreover, increasing the control 
horizon m implies that the system remains in open-loop for a longer period of time which may be 
harmful even in terms of stability if modelling errors or external perturbations occur, cf. [ jT4| . A 
detailed quantitative analysis of these effects in our setting is currently under investigation. 




5 6 7 
control horizon 




conlrol horizon 



llnal WQight 



Figure 1 1 : Weighted approximation of (left) and closed-loop cost (right) for the arm-rotor- 
platform model. 



10 Appendix 

10.1 Auxiliary results for Section |5] 

In this section we state and prove the technical Lemmata 10.1 , 10.2 10.4 and Corollary [10.3 which 
are used in order to derive formula (|26l). 



Lemma 10.1. Let N G N>2, m G {1, . . . ,A'^ — 1}, CO > I, and fj be defined as in Proposition 5.2 
satisfying ([8]). Then 



(Ym+i-co) Yl 

i=m+2 



'N-j+m+k-3 
n=k 



'N-j+m+k-3 

^ Cn + CN-j+m+k-lfO — Cpj^j^k-lG) 

n=N-i+k-2 



Yl ri>0 VA:GN 

i=m+ 1 



holds for j = N — 2, . . . ,m. 



Proof. We carry out an induction with respect to j. The induction start, j = N — 2, follows for arbitrary 
A: G N from 



CkYm+lCO-CO 



m+k—1 
n=k 



m+k- 1 

(^n + C,n+k03-CkCO 

n=k 



m+k— 1 

v. C„ + Cm+k^ 

n—k 



CO 



Ym+\ 

{CkCn - Cn+k) + {CkCm - Ck+m) « 



m— 1 

E 

n=0 



0. 
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In order to carry out the induction step from j +1 7 we rewrite the inequality in consideration for 
arbitrary but fixed k eN: 



N-j+m-2 

(Ym+l-CO) Yl (l^-l' 

i=m+2 



N-j+m+k-3 

CkYN-j+m-\— 52 (^n—CN-j+m+k-liO 
n=k 

'N-j+m+k-3 

52 Cn + CN-j+m+k-20) 
n^k+l 

" N-j+m-2 



N-j+m-2 

iYm+i-co) Yl 

i=m+2 
'^N-j+m+k-3 



52 ^" + CN-j+m+k-20i — CM-j+k-20) 

n=N-j+k-2 



n n 



>0. 



The positivity of this expression which consists of two summand follows from ([8]) and the induction 
assumption for j + 1 and k+l. □ 
In order to prove Lemma 10.4 and - as a consequence - Theorem 5.4 we require the following 
technical assertions which are stated in Lemma 10.2 and Corollary 10.3 Moreover, note that di < 0, 
Gi.bi > 0. 

Lemma 10.2. Assume 5a?_i_/ G M. Then it holds for i G N>i 



n(i+5A.-i-;0=i(n(i+5^-w) fi 

j=l k^O \j=l j=k+l 



(33) 



Proof. We carry out an induction over / to prove p3| ). Since the correctness for i = 1,2 is obvious, 
we proceed directly with the induction step 



I.A. 



i-2 



i-2 i-2 

11(1 + d^-i-j) + Yl(l + dN-i-j) 

i-2 i-2 /k-l 

n(i+5iv-i-j)+5^-i-(/-i)£ n(i+^^-i-i) n ^^-i-/ 

j=i k=i \j=i j=k+i 

i-l fk-l i-l 

k=Q Vj=1 7=fc+l 



N 



k-l 



N 



Corollary 10.3. As a consequence of ( |33| ) 

n r;= n (r.-i)+ L I n r; n (r.-i: 

j=m+2 j—m+2 k=m+2 \j=m+2 j=k+l 

holds for ji G M. Moreover, one obtains for j = N — I, . . . ,2 

!=0 



□ 



(34) 



(35) 



Proof. To see the equivalence of ( [33] ), i = N — m > 0, and ([34]), we extract the summand for ^ = 
from the right hand side of ([33]) and substitute S^-i-j by Ym+i+j — 1- Then, shifts with respect to 



the considered control variables yield the assertion. ( [35] ) is a direct consequence of the proof of ( [33] ) 
which we performed for arbitrary natural numbers with 5i = 5, i = 2, . . . ,N — I. □ 



Lemma 10.4. Let Ym+i be strictly greater than (0. Then the optimal solution X of Problem 5.3 satisfies 
AX =b, A > componentwise. 



28 



Proof. Jm+i > (0 implies a negative coefficient of Aa^-i in the objective function. Thus, the goal 
of Problem 5.3 whose optimum is denoted by X* = (Aj*, . . . , Aa^-i*), consists of maximizing Aa^-i. 
Suppose that there exists at least one index k G {1,...,A^— 1} such that Af^^X* < and deduce 
a contradiction. Let k be equal to one, define the constants £ := yi^ — 1 — '^i'^t — wA^_j > 0, 
5 :— — max,=i A?_2'^i > 0, /3 := max,=i yv-2^;5 and choose £ > such that 



i=l 



< £. 



Then, we increase A;v-i by £ and A,-, / = l,...,A^-2, by £j8(l + S)^-^-//^^-!-/ jhe choice of £ 
ensures the validity of inequality one. Since inequality j G {2, . . . ,A^ — 1} holds for A* the following 
computation shows that all other constraints are satisfied for the above choice of A,, / = I, . . . ,N — 2, 
which leads to a contradiction to the assumed optimality of A*, 



dj 



:\+d) 



N-l-j N-2 



(1 + 5) 



N-2-i 



< £ 



^aT^I + L P s:a/-I-,- +P 



£/3 



N-2-j 



i=0 



0. 



Thus, the first inequality holds with equality and k> \ which implies X^-i > 0. This enables us to re- 
duce Ayt-i without violating the non-negativity condition imposed on this variable. As a consequence, 
the first inequality is not active and all other inequalities remain valid. Hence, repeating the above 
argumentation w.r.t. k = \ proves AA* = b. 

Since the above construction is feasible for A = 0, Aa? i > holds in the optimum. Hence, 
inequality i + 1 implies A/ > for / = 1, ... — 2 which completes the proof. □ 



10.2 Proof of Lemma 7.8 



The purpose of this subsection is to prove the symmetry properties stated in Lemma 7.8 for CO > I 



(the case (O = 1 is covered by Corollary |74 1. To this end, we require the following technical lemma 



which is also an essential tool in proving monotonicity properties. 

Lemma 10.5. Let p : ^ M. be a polynomial of degree k> I such that all k roots zi, - ■ ■ ,Zk cire real, 
exactly one of them is negative, and at most one is equal to zero. In addition, let the root of p^^^^^ (z) 
be strictly smaller than —j with c > and let p{z) = z!^^^{z + c)for some z > max{zi, . . .,Zk}- Then 
it follows p{z) > z^^ ^{z + c) for all z> z. 

Proof. We prove the assertion via induction with respect to k. For k = 2 the polynomial can be written 
as p{z) — {z — a){z + b) = z^ + z{b — a)—ab with b>Q and a > 0. Due to the stated assumptions, the 
root {a — b)/2 of the first derivative is strictly smaller than —c/2. Consequently, it holds a + c <b. 
From p{z) = z^ -\- cz we derive z{b ~ a — c) — ab = 0. Thus, for z > z it holds p{z) — z(z + c) = 
zib — a — c) — ab > implying the assertion for k = 2. We perform the induction step from k to 



k+\. Let the degree of p be fc+ 1. Additionally, let p satisfy all assumptions of Lemma 10.5 
with k+l instead of k. Note that this - under consideration of the mean value theorem - guarantees 
that all derivatives of p have only strictly positive roots except for one negative root. Let zq '■= 
max{zi, . . . ,Zk+i}, i.e., < zo < z. Then we obtain p{zo) = < p{z) = z^{z + c). Thus, there exists 
z &]zo,z[: k^p'iz) > z'^^^{z+ ^). Define p := ]^p'. p has degree k > 1 and a maximal positive 
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root < z* < ZQ. Thus, there exists z** g]z*,z[: p{z**) = z**^. Now we apply the induction assumption 
to p and obtain p{z) > 2^"^^+ ftt) for all z > z**, i.e., p'{z) > (z'^iz + c))' forz > z** which allows 



□ 

Let the ^^o-function be of type (|6]). Then Lemma 7.8 states that — aj^^ > for m < 



us to conclude the assertion. 

Let the J(f ^ Q-iyxnc\io\ 
N-m,me N>o, G N>3 



Proof. Lemma 7.7 covers the case Ym+i — (o <0. Hence, we assume Ym+i — (0 > 0. Moreover, we 
suppose YN-m+i — 0) > because otherwise oc^ = 1 holds and the assertion follows. Thus, we 



only have to deal with ([26]) in order to establish the desired inequality. Choosing as small as possible 
for given m G N>i, i.e., N = 2m + 1 implies N — m = m + I. Moreover, take the following equality 
into account 



i-2 

yi = cY,<y" + (oCa'^ =c 

n=0 



c 



1 - rjo 



(36) 



with 7] := 1 + 0(0 — (0. Then, (29 1 is equivalent to 



N N 
< [rm+l(rm+2-a))-(7,„+l-£t))(7„,+ l-l)] Yl (?;--l) + (7m+l-rm+2)7m+l Yl ^' 

i=m+2 i=m+2 



^ 7-1 

< [7T!+l(rm+2-7m+l) + (7m+l-«)] n {7m+2-ym+\)Ym+l- 



i-m+2 



(37) 



If Ym+i - Ym+2 = -o"'r} > 0, i.e., rj <0 this inequality holds because H/Lm+ad^' ~ ^)/'Yi ^ (0, 1) 



Hence, we only have to deal with the case T] > 0. We aim at using Lemma 10.5 to establish the 
inequality which has to be proven. For this purpose, we require the equalities 



l-a 



and 



Ym+l {Ym+2 - Ym+l) + (7m+l - CO) 
Ym+l{Ym+2 - Ym+l) 



CO 



c ' c+ 



c 



co{\ - o) 



1 



2(7'"T] 



± 



1 



£t)(l - ft)) 

2a'"T] J ' o"'ri{l-o"'ri] 



+ 



Overall, we obtain for inequality ( [37] ) 
1 



C + 



C + 



1 



2a'" T] 



!=m+2 V 1 u // 



--■■p(c) 



where we have suppressed the argument of the roots. Since 7] E (0,1) the polynomial p{C) has 
clearly m + 1 strictly positive roots and exactly one negative root. We show that the positive root 

-l/(2a'"T]) + 



is located in the interval (0, 1), i.e., 

^0< 7](l-a'") + (7"'T](l-a'"T]). 
30 



0J(1-C7) , 1 

^ ^ < 1 + 



a'"7](l -a'"T]) 



Proposition |6 . 2| provides p{l) = q{l), i.e., using the notation of Lemma 10.5 we setz = 1. Moreover, 
we calculate the (m+ l)-first derivative of p{C): 



p('n+l)(C) = {m + 2)\C+{m+l)\{ Y ' |. 



N 



l-O 



This is a polynomial of degree one. To apply Lemma 10.5 it remains to show that its only root is 
negative. To determine the sign of its root it suffices to investigate the term 

1 ^1 1 ^1 

I j=m-\' /. I ' i=m-\- /. ' 



> 



l-o"'+^ri-m{l-o)o'"ri 

C7'"T](1 -C7"^+1t]) 
(1-CT) 



a'"(l-a'"+i77) \ to 



£(j'-m(7"' >0. 



Hence, all assumptions of Lemma 10.5| are satisfied with c = which proves the assertion for A'^ = 
2m + 1. This is the induction start. To complete the proof we have to perform the induction step, i.e., 
assuming the validity of the assertion for > 2m + 1 we have to show the correctness for + 1 . Let 
( [29l ) hold. Using the induction assumption, we aim at proving 

N+l-m N+1 N+l 

^ - Yl Yl iri-'^)irN-m+2-(0) + {rm+l-rN-m+2)Ylyi 

m+1 N—in+2 m+l 

N N-m N 

-{rN+i-'^){rm+i-rN-m+i)Ylyi-(yN+i-i){rN-m+i-(o)Yl n (y-'^^ 

m+l m+l A'— m+l 

A' 

< [7yv+i(rm+i-rw-m+2)-(r^+i-i)(rm+i-7w-m+i)] n y 

=7^+1 (rw-m+i - riv-m+2 )+(/<«+ 1 -rw-m+i ) 

iV+1 

+ [7V-m+l(7V-m+2-a')-(7V-m+l-a»)(ryV-m+l-l)] W (T^'-I) 
' ^ 'W-m+2 

^0 < -[r^-m+irw+iCcT^"™7]+r^_^+iC(cT™-(7^-™)7]] n 



(38) 



N-m+2 



N 



+ [YN-m+iiYN+i - '^)Co^ '"'n + {YN+i-\){YN-,„+i-co)] Yl 

A'-m+2 

Thus, T] < guarantees the validity of the considered inequality. Hence, let 7] > 0. Note that 
T] = 1 - (o(l - a) < 1. We rewrite (|38]) as follows 



^C(T^-'"TJ + (cT'"-(T^-'")TjjcC"' n ^+[7«-+iC(T^"'"^ + (7iV-™+l-«)] - 1) > 



n 

N-m+2 



7N-m+l ^2 _j_ 7N-m+\ — O) 



=N-m+\ 



y,ic 



=:p(C) 



=:q(C) 



Note that both polynomials have the coefficient one, i.e., are normed (C"'+^). Moreover, q{C) has 
exactly one negative root located at — (a"' — a^^'") (1 — a) / ( ( 1 —r\ o^) o^^"^). Next, we consider 
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the term {yi+i — 1)/ {Yi/C) more closely. This leads to 

r ( ^-^'^ \ _ hz^ 



-C 



Ji/C I-ct'-It] l-a'-^T]' 

Thus, the polynomial ('yj+i — l)/('y;/C) has its root at (1 — 0')/(l — o'r\), i.e., in the interval (0, 1). 
We aim at determining the roots of the term 



Yn+i rN+i<y^-'"r) a^-'"7]7^+i/C' 
To this end, we have to solve the equation 

-I c ^ - = 

This leads to 



Thus, there is one negative and one positive root and p{C) may be represented by p{C) = Yll^i^iC — 
Zi) where z, denote the determined roots. Show that the obtained positive root is also located in (0, 1), 
i.e., 

l+4(7^-'"T](o(l-a)/(l-cj^-'"T]) < (l+2a^-"^T])2 = l+4a^-'"T](l+(j^-'"T]) 
^ «(l-(j) < (l+(j^-'"T])(l-a^-"'T]) = l-(a^-'"77)2 

Calculate the (m+ 1)^'^ derivative of p{C) and ^(C) 



JV 



We show that the root of p^^'+i) is strictly smaller than its counterpart of q^'"^^\ i.e.. 



1 ^ 1-C7 (c7™-a^-'")(l-c7) ^ 



a^-'"T? 1 - a'T] (1 - a^7])a 

Thus, it suffices to show 

^ ^ 1 OT(l-a) (cj'"-(j'^-'")(l-(7) 



< (1 - (t'^t?)(1 - cj'^-'"+'t7) -m(l - (j)77(l - (j'^t])^"-'" - 77(ff"' - a^-"'){l - a){l - a^-'"+^ri). 

N-l 
i=0 



Using (1-a^T]) = (1 - a)(l - a^77)/(l- a) = (l-a)(l|!;o^ a' + c7^(o) provides 



/m-l jV-1 

(l-CT"-"+'?7)(l-Jj)(f7'"-CT'^-'") + (l-t7"-"+'?7) £ f7' + t7"-'" + CT"ffl) -m?7(l-CT"j7)f7"-"'>0. 

\i=0 /=m+l / 

Observe that the first summand is positive, 7] < 1 and E'vLq^ ^' > "^<7'", and L/L7„Vi ^' — 
l)c7^~^ > mo^^^. Hence, the following calculation establishes the desired inequality 

< (1 - a^-"'+^ri){o"' + o^-^)-{\- a^'n)o^-"' ^ < a"' - a^-"' + a^+^ - o^+^t]. 



m 



In consideration of Proposition 6.2, all assumptions of Lemma 10.5 are satisfied. This shows the 



assertion due to the definition of p and q. □ 
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10.3 Proof of Lemma l7J2l 



Proof. Due to Lemma [7^ we restrict ourselves to the case 7„,+i — (O > 0. Taking into accout N — m 
m + 2 we have a = Co'^T] (0{Ym+2 — 1 ) ■ Thus, ( [3T] ) is equivalent to 

N N 

{Ym+2Co"'ri(0{Ym+2-^) + (0{Ym+l- C0){Ym+2-'i-)) Y[ (Yi - ^) > Co""!] C0{Ym+2 - ^)Y>n+2 Y[ Y' 

i=m+3 i=m+3 

Using C(7'^rico{Y,n+2 - 1)7^+2 = C^{o'"rico{\ - (7'"+^ri)/{\ - o)) yields 

^ ^ l-a 



>c 



=:^(C) 



-:p{C) 



Clearly, the polynomial H/Lm+s (C — ( 1 — c) /( 1 — a' — 1 r/ ) is of degree m and decomposed in linear 
factors whose roots are located in the open interval (0, 1). The other factor of p{C) can be represented 
as 

1 - 0'"ri ± a/(1 -a™T])2 + 4ft)(l -(7)C7'"T](1 -c7'"+i77; 



c+ 



2o"'ri{\-o"'+^ri] 



Hence, this polynomial has one strictly positive and one strictly negative root. We show that the 
positive root is located in (0, 1), i.e., is strictly less than one: 

(1 - a"'ri +2a™T7(l - o"'+^ri)f > (1 - ct^t])^ + 4(o(l - C7)c7'"77(l - a'"+^ri) 
^ (2a'"77(l-a'"+iT]))2 + 4772a'"(l-c7'"+^7])(l-c7™) >0. 

We calculate the (m+ 1)'^' -derivative of the polynomial p{C) which has degree (m + 2) 



(«.+l)(C) = (m + 2)!C+(m+l)!( L_^!\_ _ f ^ 

We aim at proving that the root of p^'"^^\C) is strictly negative. To this purpose, it suffices to establish 
the following inequality 

1 - a"77 ^ 1 - (7 

which is in turn equivalent to 



>0 



1 _ n-'"n "'^^ ^1 
= y g' + (o>mg'">mT7cr">T7cy"(l-g'"+^77) V 

1=0 !=m+3 ' 



Under consideration of Proposition 6.2 all assumption of Lemma 10.5 are satisfied. Thus, we con- 
clude the assertion. □ 
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